Study of interaction fidelity for two viewpoint changing techniques in a virtual biopsy trainer

International audienceVirtual Reality simulators are increasingly used for training novice surgeons. However, there is currently a lack of guidelines for achieving interaction fidelity for these systems. In this paper, we present the design of two navigation techniques for a needle insertion trainer. The two techniques were analyzed using a state-of-the-art fidelity framework to determine their levels of interaction fidelity. A user study comparing both techniques suggests that the higher fidelity technique is more suited as a navigation technique for the needle insertion virtual trainer

3D interaction assistance in virtual reality: A semantic reasoning engine for context-awareness: From interests and objectives detection to adaptations

International audienceThis work aims to provide 3D interaction assistance in virtual environments depending on context. We designed and implemented a generic decision engine that can connect to our existing virtual reality applications through a set of tools. It uses an ontology and Conceptual Graphs (CGs) to represent knowledge, and First Order Logic to conduct semantic reasoning. Context information are gathered by virtual sensors in the application and interpreted by the engine. Multimodal assistance is provided by virtual actuators. Our first test scenario is about assistance to selection of objects or navigation towards objects: the engine automatically detects user's interests and manages adaptations depending on user's hand gestures, interactions history and type of task

A Distributed Software Architecture for Collaborative Teleoperation based on a VR Platform and Web Application Interoperability

Augmented Reality and Virtual Reality can provide to a Human Operator (HO) a real help to complete complex tasks, such as robot teleoperation and cooperative teleassistance. Using appropriate augmentations, the HO can interact faster, safer and easier with the remote real world. In this paper, we present an extension of an existing distributed software and network architecture for collaborative teleoperation based on networked human-scaled mixed reality and mobile platform. The first teleoperation system was composed by a VR application and a Web application. However the 2 systems cannot be used together and it is impossible to control a distant robot simultaneously. Our goal is to update the teleoperation system to permit a heterogeneous collaborative teleoperation between the 2 platforms. An important feature of this interface is based on different Mobile platforms to control one or many robots

Advanced hybrid tracking through neural network regression

International audienceWe present an optical-haptic tracking system suitable for augmented and virtual reality applications. The paper addresses tow issues of such system. The first one concerns the calibration method that can be used to calibrate the force feedback device: SPIDAR. The second contribution is about the development of a hybrid tracking system. The proposed hybridization aims to provide both accurate and interrupted position data

MVC-3D: Adaptive Design Pattern for Virtual and Augmented Reality Systems

International audienceIn this paper, we present MVC-3D design pattern to develop virtual and augmented (or mixed) reality interfaces that use new types of sensors, modalities and implement specific algorithms and simulation models. The proposed pattern represents the extension of classic MVC pattern by enriching the View component (interactive View) and adding a specific component (Library). The results obtained on the development of augmented reality interfaces showed that the complexity of M, iV and C components is reduced. The complexity increases only on the Library component (L). This helps the programmers to well structure their models even if the interface complexity increases. The proposed design pattern is also used in a design process called MVC-3D in the loop that enables a seamless evolution from initial prototype to the final system

Low-cost VR Collaborative System equipped with Haptic Feedback

International audienceIn this paper, we present a low-cost virtual reality (VR) collaborative system equipped with a haptic feedback sensation system. This system is composed of a Kinect sensor for bodies and gestures detection, a microcontroller and vibrators to simulate outside interactions, and smartphone powered cardboard, all of this are put into a network implemented with Unity 3D game engine. CCS CONCEPTS • Interaction paradigms → Virtual reality; Collaborative interaction; • Hardware → Sensors and actuators; Wireless devices; KEYWORDS collaborative virtual reality, haptic feedback system